Voice processing system

ABSTRACT

There is provided a voice processing system capable of acquiring user voice more clearly, the voice processing system including: a mounting unit configured to be attached to a user. The mounting unit includes at least three voice acquisition units configured to acquire voice data for beamforming.

CROSS-REFERENCE TO PRIOR APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/504,063 (filed on Feb. 15, 2017), which is a National Stage PatentApplication of PCT International Patent Application No.PCT/JP2015/070040 (filed on Jul. 13, 2015) under 35 U.S.C. § 371, whichclaims priority to Japanese Patent Application No. 2014-213496 (filed onOct. 20, 2014), which are all hereby incorporated by reference in theirentirety.

TECHNICAL FIELD

The present disclosure relates to a voice processing system.

BACKGROUND ART

In recent years, we arable devices that sense a user's state, capture orrecord surroundings, and output various information items to the userwhile being worn on any part of the user's body are becoming widespread.In one example, wearable devices are used in various fields includinglife log and sports support.

The information acquired by the wearable device can be greatly affecteddepending on the part to be attached, the user's state, and thesurrounding environment. In one example, as for voice, a voice utteredfrom the user's mouth (also referred to as a “user voice”, hereinafter)may be buried in noise including frictional sound between a wearabledevice and clothes, sound related to vibration, and surroundingenvironmental sound. Thus, it is desirable to provide a technique ofacquiring the user voice more clearly.

In one example, Patent Document 1 discloses technology for acquiring avoice signal with reduced noise and enhanced user voice by performingmicrophone array processing on a voice signal inputted through each oftwo microphones provided in a headset.

Citation List Patent Literature

Patent Literature 1: JP 2005-303574A

DISCLOSURE OF INVENTION Technical Problem

However, further improvement in performance is desirable in thistechnical field. Thus, the present disclosure provides a novel andimproved voice processing system capable of acquiring the user voicemore clearly.

Solution to Problem

According to the present disclosure, there is provided a voiceprocessing system including: a mounting unit configured to be attachedto a user. The mounting unit includes at least three voice acquisitionunits configured to acquire voice data for beamforming.

Advantageous Effects of Invention

According to the present disclosure as described above, it is possibleto acquire the user voice more clearly. Note that the effects describedabove are not necessarily limitative. In conjunction with or in place ofthe above effects, there may be achieved any of the effects described inthis specification or other effects that may be identified fromdescription of this specification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an example of an appearanceconfiguration of a voice processing system according to an embodiment ofthe present disclosure.

FIG. 2 is a diagram illustrating an example of the appearanceconfiguration of the voice processing system according to the presentembodiment.

FIG. 3 is a diagram illustrating an example of the appearanceconfiguration of the voice processing system according to the presentembodiment.

FIG. 4 is a diagram illustrating another example of the appearanceconfiguration of the voice processing system according to the presentembodiment.

FIG. 5 is a diagram illustrating another example of the appearanceconfiguration of the voice processing system according to the presentembodiment.

FIG. 6 is a diagram illustrating an example of an appearanceconfiguration of a voice processing system according to a comparativeexample.

FIG. 7 is a diagram illustrated to describe an arrangement scheme of avoice acquisition unit according to the present embodiment.

FIG. 8 is a diagram illustrated to describe the arrangement scheme ofthe voice acquisition unit according to the present embodiment.

FIG. 9 is a diagram illustrated to describe the arrangement scheme ofthe voice acquisition unit according to the present embodiment.

FIG. 10 is a diagram illustrated to describe the arrangement scheme ofthe voice acquisition unit according to the present embodiment.

FIG. 11 is a block diagram illustrating an example of an internalconfiguration of the voice processing system according to the presentembodiment.

FIG. 12 is a flowchart illustrating an example of a voice signalprocessing procedure executed in the voice processing system accordingto the present embodiment.

MODE(S) FOR CARRYING OUT THE INVENTION

Hereinafter, (a) preferred embodiment(s) of the present disclosure willbe described in detail with reference to the appended drawings. In thisspecification and the appended drawings, structural elements that havesubstantially the same function and structure are denoted with the samereference numerals, and repeated description of these structuralelements is omitted.

Furthermore, in this specification and the drawings, components havingsubstantially the same functional configuration may be distinguished byattaching different alphabets after the same reference numerals. In oneexample, like voice acquisition units 110A, 110B, and 110C, a pluralityof components having substantially the same functional configuration aredistinguished as necessary. However, in a case where it is not necessaryto particularly distinguish each of a plurality of components havingsubstantially the same functional configuration, only the same referencenumeral is attached. In one example, in the case where it is notnecessary to particularly distinguish the voice acquisition units 110A,110B, and 110C, they are simply referred to as a voice acquisition unit110.

The description will be given in the following order.

1. Appearance Configuration

2. Arrangement of Voice Acquisition Unit

2-1. Arrangement Scheme

2-2. Practical Arrangement Example

3. Internal Configuration

4. Operation Processing

5. Brief Summary

<1. Appearance Configuration>

An appearance configuration of a voice processing system according to anembodiment of the present disclosure will be described with reference toFIGS. 1 to 6.

FIGS. 1 to 3 are diagrams illustrating an example of an appearanceconfiguration of a voice processing system according to the presentembodiment. As illustrated in FIGS. 1 to 3, the voice processing system1 according to the present embodiment has a. mounting unit that isshaped to make a half turn around the neck from both sides of the neckto the rear side (back side). Then, the mounting unit is attached to theuser by being hooked on the user's neck. Moreover, FIGS. 1 to 3illustrate views of the state in which the mounting unit is attached tothe user from various viewpoints. Specifically, FIG. 1 is a perspectiveview thereof, FIG. 2 is a perspective view thereof viewed from the rightside of the user, and FIG. 3 is a plan view thereof viewed from theupper side of the user.

Moreover, in this specification, although terms indicating directionssuch as left, right, upper, lower, fore, and back sides are used, thesedirections are intended to indicate directions viewed from the center ofthe user's body (e.g., position of solar plexus) in the upright postureof the user as illustrated in FIG. 8 to be described later. In oneexample, the term “right side” indicates the direction of the right halfof the user, the term “left side” indicates the direction of the lefthalf of the user, the term “upper side” indicates the direction of thehead side of the user, and the “lower side” indicates the direction ofthe feet side of the user. Furthermore, the term “fore side” indicatesthe direction in which the user's body faces, and the term “back side”indicates the direction of the rear side of the user.

As illustrated in FIGS. 1 to 3, the mounting unit according to thepresent embodiment may be a neck hanging type that is worn around theuser's neck. The mounting unit may be worn in close contact with theuser's neck or may be worn with a space between them. An example ofanother shape of the neck hanging type mounting unit includes a pendanttype that is attached to a user with a neck strap and a headset typehaving a neckband passing along the back side of the neck instead of aheadband to be worn on the head.

The usage pattern for the mounting type unit may have a pattern usedwhile being directly worn on the human body. The usage pattern of usingwhile being directly worn refers to a pattern used in a state where noobject exists between the mounting type unit and the human body. In oneexample, this usage pattern corresponds to a case where the mountingunit illustrated in FIGS. 1 to 3 is worn to be in contact with the skinof the user's neck. Furthermore, various usage patterns, such as aheadset type and eyeglass type worn directly on the head, can beconsidered.

The usage pattern of the mounting type unit may be a pattern that isused by being indirectly worn on the human body. The usage pattern ofusing while being indirectly worn refers to a pattern used in a state inwhich an object exists between the mounting type unit and the humanbody. In one example, this usage pattern corresponds to the case wherethe mounting unit illustrated in FIGS. 1 to 3 is worn to be in contactwith the user from above the clothes, such as being worn to be hiddenunder the collar of the shirt. Furthermore, various patterns, such as apendant type to be attached to a user with a neck strap and a broachtype to be fastened to clothes with fasteners, can be considered.

The mounting unit has a plurality of voice acquisition units 110 (110A,110B, 110C, and 110D) as illustrated in FIGS. 1 to 3. The voiceacquisition unit 110 acquires voice data, such as a voice of the user, avoice uttered by a user's conversation partner, and ambientenvironmental sound. The voice data acquired by the voice acquisitionunit 110 is a target to be subject to beamforming processing for makinguser's voice clear, for making a voice uttered by a user's conversationpartner clear, and for reducing other noise. As illustrated in FIGS. 1to 3. in the case where the voice acquisition unit is provided on aportion that does not face the user side (e.g., a surface opposite to asurface that is in contact with the user) so that the voice acquisitionunit is not directly in contact with the user. Thus, it is possible toreduce the influence of noise caused by the friction between the neckand the mounting unit. Moreover, FIGS. 1 to 3 illustrate theconfiguration in which four voice acquisition units 110 are provided inthe mounting unit, but the present technology is not limited to thisexample. In one example, the mounting unit may have at least three voiceacquisition units, and may have five or more voice acquisition units.

The voice processing system 1 according to the present embodiment may beimplemented as a single mounting unit or may be implemented as acombination of a plurality of devices. In one example, the voiceprocessing system 1 may be implemented as a combination of a neckhanging type mounting unit illustrated in FIGS. 1 to 3 and a wristbandtype mounting unit that is worn on the user's arm. Then, the voiceprocessing system 1 may perform beamforming processing using voice dataacquired by a plurality of voice acquisition units provided in aplurality of devices. In the following description, the voice processingsystem I is assumed to be implemented as a single mounting unitillustrated in FIGS. 1 to 3.

Other examples of the mounting unit are illustrated in FIGS. 4 and 5.FIGS. 4 and 5 are diagrams illustrating another example of theappearance configuration of the voice processing system according to thepresent embodiment.

FIG. 4 illustrates the appearance configuration of a voice processingsystem 1 that includes a single glasses type mounting unit. FIG. 5illustrates the appearance configuration of a voice processing system 1that includes a single neckband type mounting unit. In the examplesillustrated in FIGS. 4 and 5, the voice processing system 1 has aplurality of voice acquisition units 110 110A, 110B, 110C, and 110D)similarly to the examples illustrated in FIGS. 1 to 3.

A comparative example will be described with reference to FIG. 6. FIG. 6is a diagram illustrating an example of an appearance configuration of avoice processing system according to the comparative example. The leftand right views of FIG. 6 illustrate an appearance configuration exampleof a so-called Bluetooth (registered trademark) headset. In the exampleillustrated in the left view of FIG. 6, the voice processing systemaccording to the comparative example has two voice acquisition units 910(910A and 910B), and is attached to the user by putting it on the user'sright ear. In the example illustrated in the right view of FIG. 6, thevoice processing system according to the comparative example has twovoice acquisition units 910 (910C and 910D) provided symmetrically oncables connected to the left and right earphones. In this way, both theexamples illustrated in the left and right views of FIG. 6 have twovoice acquisition units.

In the wearable device, in some cases, the microphone and the user'smouth are apart from each other in use, and the user's voice is buriedin the noise. It is difficult to solve such a problem even if thebeamforming processing using the voice data acquired by the two voiceacquisition units as in the comparative example is performed.

Thus, in the present embodiment, an arrangement of the voice acquisitionunit 110 is developed to improve noise reduction performance in the casewhere noise is reduced by the beamforming processing.

<2. Arrangement of Voice Acquisition Unit>

[2-1. Arrangement Scheme]

The arrangement scheme of the voice acquisition unit 110 will bedescribed with reference to FIGS. 7 to 10.

FIG. 7 is a diagram illustrated to describe an arrangement scheme of thevoice acquisition unit 110 according to the present embodiment. Asillustrated in the left view of FIG. 7, the first arrangement scheme isto arrange the voice acquisition unit 110 linearly with respect to adirection 210 in which the target sound arrives. Furthermore, asillustrated in the left view of FIG. 7, the second arrangement scheme isto arrange the voice acquisition unit 110 linearly with respect to adirection 220 in which the noise to be reduced arrives. In the presentembodiment, the voice acquisition units 110A and 110B can be arrangedlinearly with respect to the direction 210 of the user's mouth, which isthe direction in which the user's voice regarded as target soundarrives. In accordance with the first and second arrangement schemes, itis possible to reduce efficiently the noise component coming from theopposite direction 220. This is because the phase difference (timedifference) until the user's voice coming from the direction 210 of theuser's mouth reaches the voice acquisition units 110A and 110B is large,and the phase difference until the voice coming from the oppositedirection 220 reaches the voice acquisition units 110B and 110A is alsolarge. As shown by the polar pattern illustrated on the right side ofFIG. 7, the user voice coming from the direction 210 of the user's mouthis enhanced by the beamforming processing to be performed by thecontroller 160 to be described later, and noise components coming fromthe opposite directions 220A, 220B, and 220C are reduced.

The arrangement scheme of the voice acquisition unit 110 associated withthe direction in which the noise to be reduced arrives will be describedin detail with reference to FIG. 8.

FIG. 8 is a diagram illustrated to describe the arrangement scheme ofthe voice acquisition unit 110 according to the present embodiment. Asillustrated in

FIG. 8, in the present embodiment, the third arrangement scheme is toarrange the voice acquisition units 110A and 110B linearly with respectto the lower side direction. Assuming that the voice processing system 1is used outdoors, most of the noise occurred from the outside arrivesfrom the direction of the ground (lower side direction) or thehorizontal direction using the user's mouth illustrated in FIG. 8 as thereference. Moreover, the noise coining from the direction of the groundis also called road noise. In accordance with this arrangement scheme,the voice acquisition unit 110 is arranged linearly with respect to thelower side direction in which the road noise arrives, and thus the roadnoise can be reduced efficiently by the beamforming processing.Furthermore, in accordance with this arrangement scheme, for noisecoming from an oblique direction between the lower side direction andthe horizontal direction, there is a phase difference until the noisereaches the voice acquisition units 1103 and 110A, and thus thebeamforming processing can reduce the noise. In this way, in accordancewith this arrangement scheme, it is possible to reduce efficiently noisein outdoor environments. Moreover, in some cases, reduction may bedifficult for propeller sound of a helicopter, sound from a liquidcrystal display installed above the head, and the like. Undoubtedly,depending on the shape of the mounting unit, the voice acquisition units110A and 110B are not necessarily arranged strictly linearly in thelower side direction (perpendicular direction), or they may be arrangedto be inclined.

Next, the arrangement scheme in the case where four or more voiceacquisition units 110 are provided will be described in detail withreference to FIGS. 9 and 10.

FIG. 9 is a diagram illustrated to describe the arrangement scheme ofthe voice acquisition unit 110 according to the present embodiment. Asillustrated in the left view of FIG. 9, in the present embodiment, thefourth arrangement scheme is to arrange a plurality of voice acquisitionunits 110 three-dimensionally. Specifically, the shape formed byinterconnecting positions where four voice acquisition units 110 areprovided is three-dimensional. Moreover, the term “three-dimensional”can be regarded as the case where three voice acquisition units 110 areprovided and the remaining one voice acquisition unit 110 is notprovided on a plane including the positions of the three voiceacquisition units 110. In such a three-dimensional arrangement, a phasedifference occurs in the voice data acquired by any two or more voiceacquisition units 110 for any voice coming from any direction, and thusit is possible to reduce the noise coming from any direction.Furthermore, as illustrated in the left view of FIG. 9, the shape formedby interconnecting the positions where the four voice acquisition units110 are provided is a regular tetrahedron. The shape formed byinterconnecting the positions where the plurality of voice acquisitionunits 110 are provided is desirable to be a regular polyhedron such as aregular tetrahedron in which the distances from each of the voiceacquisition units 110 to the user's mouth are equally spaced. Asillustrated in the right view of FIG. 9, the shape formed byinterconnecting the positions where the four voice acquisition units 110are provided undoubtedly may be a tetrahedron, but not necessarily aregular tetrahedron, depending on the shape of the mounting unit.

FIG. 10 is a diagram illustrated to describe the arrangement scheme ofthe voice acquisition unit 110 according to the present embodiment. Asillustrated in FIG. 10, in the present embodiment, the fifth arrangementscheme is to bring at least one of the voice acquisition units 110 closeto the user's mouth. In accordance with this arrangement scheme, atleast one voice acquisition unit 110 can acquire the user voice having alarger sound volume than other noises. This makes it possible toincrease further the effect of the user voice enhancement by thebeamforming processing. In one example, as illustrated in FIG. 10, afifth voice acquisition unit 110E may be provided at a position closerto the user's mouth than the four voice acquisition units 110 forming atetrahedron. In addition, in one example, as illustrated in the rightview of FIG. 9, one (the voice acquisition unit 110A in the exampleillustrated in the right view of FIG. 9) of the voice acquisition units110 located at the vertexes of the tetrahedron may be provided closestto the user's mouth.

The arrangement scheme of the voice acquisition unit 110 has beendescribed above.

[2-2. Practical Arrangement Example]

Subsequently, referring again to FIGS. 1 to 3, a practical arrangementexample of the voice acquisition unit 110 in accordance with theabove-mentioned arrangement schemes will be described. Moreover, thepractical arrangement of the voice acquisition unit 110 may notnecessarily completely conform to the arrangement scheme described abovedue to the constraint conditions such as the shape of the mounting unitand the weight of each component.

The first arrangement scheme will be described. As illustrated in FIG.2, in a state where the mounting unit is attached to the user, the voiceacquisition unit 110A and the voice acquisition unit 110B are arrangedin the same direction when viewed from the user's mouth. Furthermore, inthe state where the mounting unit is attached to the user, the distancebetween the voice acquisition unit 110A (a first voice acquisition unit)included in the four voice acquisition units 110 and the user's mouthand the distance between the voice acquisition unit 110B (a second voiceacquisition unit) included in the four voice acquisition units 110 andthe user's mouth are set to be different from each other. In this way,in the examples illustrated in FIGS. 1 to 3, the voice acquisition units110A and 110B are arranged linearly with respect to the direction of theuser' mouth at which the target sound arrives, and thus it is possibleto enhance efficiently the user voice by the beamforming processing.

Next, the second and third arrangement schemes will be described. Asillustrated in FIG. 2, in the state where the mounting unit is attachedto the user, the voice acquisition unit 110A and the voice acquisitionunit 110B are arranged in the same direction when viewed from the user'smouth. Furthermore, in a state where the mounting unit is attached tothe user, the voice acquisition unit 110A (the first voice acquisitionunit) and the voice acquisition unit 110B (the second voice acquisitionunit) are provided to be closer to the user's feet than the user's mouthin the user's upright posture. In this way, in the examples illustratedin FIGS. 1 to 3, the voice acquisition units 110A and 110B are arrangedlinearly with respect to the direction of the ground where the noise tobe reduced arrives, and thus it is possible to reduce efficiently thenoise by the beamforming processing.

Next, the fourth arrangement scheme will be described. As illustrated inFIGS. 1 to 3, the shape formed by interconnecting the positions at whichthe voice acquisition units 110A, 110B, 110C, and 110D are provided isthree-dimensional. In this way, in the example illustrated in FIGS. 1 to3, the plurality of voice acquisition units 110 are arrangedthree-dimensionally, and thus it is possible to reduce the noise comingfrom any direction by the beamforming processing.

Next, the fifth arrangement scheme will be described. As illustrated inFIGS. 1 to 3, in a state in which the mounting unit is attached to theuser, the voice acquisition unit 110A (the first voice acquisition unit)is provided at a position closest to the user's mouth. In this way, inthe examples illustrated in FIGS. 1 to 3, the voice acquisition unit110A is provided at a position close to the user's mouth, and thus it ispossible to acquire the user voice having a larger sound volume thanother noises. Furthermore, with regard to the second and thirdarrangement conditions, in a state in which the mounting unit isattached to the user, the voice acquisition unit 110B (the second voiceacquisition unit) is provided closer to the feet side of the user thanthe voice acquisition unit 110A (the first voice acquisition unit) thatis provided closest to the user's mouth in the user's upright posture.This makes it possible to achieve both the effect of the user's voiceenhancement and the noise reduction in the examples illustrated in FIGS.1 to 3. In the examples illustrated in FIGS. 1 to 3, the voiceacquisition unit 110A is provided closer to the lower side than theuser's mouth, but the voice acquisition unit 110A may he provided closerto the upper side than the user's mouth.

The arrangement of the voice acquisition unit 110 in the voiceprocessing system 1 according to the present embodiment has beendescribed above. Subsequently, the internal configuration of the voiceprocessing system 1 according to the present embodiment will bedescribed with reference to FIG. 11.

<3. Internal Configuration>

FIG. 11 is a block diagram illustrating an example of the internalconfiguration of the voice processing system 1 according to the presentembodiment. As illustrated in FIG. 11, the voice processing system 1 isconfigured to include voice acquisition units 110A to 110D, an imagecapture unit 120, an operation unit 130, a sensor unit 140, acommunication unit 150, and. a controller 160.

(1) Voice Acquisition Unit 110

The voice acquisition unit 110 has a function of acquiring voice datafor beamforming. In one example, the voice acquisition unit 110 acquiresthe user voice uttered by a user who wears the voice processing system 1(the mounting unit) or acquires surrounding sound. In one example, thevoice acquisition unit 110 is implemented as a microphone. The voiceacquisition unit 110 may be provided in one mounting unit, may beprovided in a device separate from the mounting unit, or may bedistributed in a plurality of devices. In one example, the voiceacquisition unit 110 may be provided in wristband type mounting units,eyeglass type mounting units, and smartphones, in addition to the neckhanging type mounting unit illustrated in FIGS. 1 to 3.

The voice acquisition unit 110 is not necessarily a directionalmicrophone. In one example, the voice acquisition unit 110 may be amicrophone having omnidirectional sensitivity. The term “omnidirectionalsensitivity” means that there is no region (orientation) ofinsensitivity in the polar pattern. Such a microphone may also bereferred to as a semi-directional microphone. Furthermore, the voiceacquisition unit 110 may be a microphone whose sensitivity is uniform orsubstantially uniform in all directions. The term “uniform orsubstantially uniform in all directions” means that the sensitivity hasa circular polar pattern, but it is not necessarily a true circle. Inother words, the voice acquisition unit 110 may be an omnidirectionalmicrophone.

The voice acquisition unit 110 may include a microphone amplifiercircuit or an analog-to-digital (A/D) converter that amplifies the voicesignal acquired by the microphone. The voice acquisition unit 110outputs the acquired voice data to the controller 160.

(2) Image Capture Unit 120

The image capture unit 120 is configured to include a lens system, adriving system, and a solid-state image sensor array. The lens systemincludes an image capture lens, a diaphragm, a zoom lens, a focus lens,and the like. The driving system causes a lens system to perform afocusing operation or a zooming operation. The solid-state image sensorarray converts light for image capturing obtained by the lens systeminto electric energy to generate an image capture signal. Thesolid-state image sensor array may be implemented as, in one example, acharge coupled device (CCD) sensor array or a complementarymetal-oxide-semiconductor (CMOS) sensor array. In one example, the imagecapture unit 120 may be provided to be capable of capturing the foreside of the user in a state in which the voice processing system (themounting unit) 1 is attached to the user. In this case, the imagecapture unit 120 can capture an image of the user's conversationpartner, in one example. Furthermore, the image capture unit 120 may beprovided to be capable of capturing an image of the user's face in thestate where the voice processing system 1 is attached to the user. Inthis case, the voice processing system 1 can specify the position of theuser's mouth from the captured image. The image capture unit 120 outputsdata of the captured image composed of digital signals to the controller160.

(3) Operation Unit 130

The operation unit 130 is operated by the user and has a function ofreceiving an input from the user. In one example, the operation unit 130may be implemented as a camera button that receives an input forinstructing the image capture unit 120 to capture a still image, aninput for instructing to start or stop capturing a moving image.Furthermore, the operation unit 130 may be implemented as a voice inputbutton that receives an input for instructing the voice acquisition unit110 to start or stop inputting the voice. Furthermore, the operationunit 130 may be implemented as a touch slider that receives a touchoperation or a slide operation. Furthermore, the operation unit 130 maybe implemented as a power button that accepts an operation forinstructing the voice processing system 1 to turn the power ON or OFF.The operation unit 130 outputs information that indicates user input tothe controller 160.

(4) Sensor Unit 140

The sensor unit 140 has a function of sensing the state or thesurrounding state of the user wearing the voice processing system 1. Inone example, the sensor unit 140 may include at least one of anaccelerometer, a speedometer, a gyro sensor, a geomagnetic sensor, aglobal positioning system (GPS) module, and a vibration sensor. Thesensor unit 140 may be provided in a device separate from the mountingunit, or may be provided in a distributed manner in a plurality ofdevices. In one example, the wristband type device may be provided witha pulse rate meter, and the smartphone may be provided with a vibrationsensor, The sensor unit 140 outputs information indicating a resultobtained by sensing to the controller 160.

(5) Communication Unit 150

The communication unit 150 is a communication module for exchanging databetween the voice processing system 1 and other devices by wired orwireless connection. The communication unit 150 directly communicates,or wirelessly communicate via a network access point, with an externaldevice, using a communication scheme such as wired. local area network(LAN), wireless LAN, wireless fidelity (Wi-Fi, registered trademark),infrared communication, Bluetooth, and near field communication (NFC).

In one example, in a case where a function of serving as the controller160 to be described later is included in other devices such as asmartphone or a server on the cloud, the communication unit 150 maytransmit data acquired by the voice acquisition unit 110, the imagecapture unit 120, the operation unit 130, and the sensor unit 140. Inthis case, the other device performs beamforming processing, voicerecognition processing, and the like. in addition, in one example, in acase where the voice acquisition unit 110, the image capture unit 120,the operation unit 130, or the sensor unit 140 is provided in a separatedevice, the communication unit 150 may receive the data acquired by themand output it to the controller 160. Furthermore, the communication unit150 may transmit the voice data obtained after the beamformingprocessing by the controller 160 to a storage device for storing thevoice data.

(6) Controller 160

The controller 160 functions as both an arithmetic processing unit and acontroller, and controls the overall operation in the voice processingsystem 1 in accordance with various programs. The controller 160 isimplemented as an electronic circuit such as a central processing unit(CPU) and a microprocessor.

Moreover, the controller 160 may include read-only memory (ROM) forstoring programs to be used, calculation parameters, or the like, andmay include random-access memory (RAM) for temporarily storingappropriately varying parameters, or the like.

In one example, the controller 160 performs beamforming processing offorming the directivity to acquire a voice corning from the direction ofthe user's mouth using a plurality of voice data items acquired by thevoice acquisition unit 110. The beamforming processing is a process ofchanging the degree of enhancement for each area where sound arrives.More specifically, the beamforming processing performed by thecontroller 160 may include a process of reducing sound coming from aspecific area, or may include a process of enhancing sound coming from adesired orientation. In one example, the controller 160 may regard avoice coming from a direction other than the direction of the user'smouth as noise to be reduced. Furthermore, the controller 160 mayenhance a voice coining from the direction of the user's mouth. Asdescribed above, the voice acquisition unit 110 does not necessarilyhave its own directivity. The controller 160 controls the directivity byperforming the beamforming processing on the voice data acquired by eachof the voice acquisition units 110. The controller 160 can perform thebeamforming processing using the phase difference between the voice dataitems acquired by each of the voice acquisition units 110.

The controller 160 can control the beamforming processing from variousviewpoints. In one example, the controller 160 may control the directionand/or the range of forming the directivity from the viewpoint describedbelow as an example.

In one example, the controller 160 may control the beamformingprocessing based on the positional relationship between a noise sourceand the voice acquisition unit 110. In one example, as described above,the noise source of a road is the ground, and thus the controller 160may control the beamforming processing to reduce a voice coming from thedirection of the ground. Furthermore, in one example, in a case where itcan he determined that there is a road or a line having a large trafficvolume in a specific direction from the positional information, thecontroller 160 may control the beamforming processing to reduce thesound from the direction. In addition, in a case where there is a userinstruction to specify the position of the noise source in one example,the controller 160 may control the beamforming processing to reduce thesound coining from the position indicated by the user instruction.

In one example, the controller 160 may control the beamformingprocessing based on the position of a speaker other than the user. Inone example, the controller 160 may perform beamforming processing forenhancing a voice coming from a speaker other than the user.Furthermore, the controller 160 may perform beamforming processing forreducing a voice coming from another speaker other than the user. It isconsidered that there are various ways to specify the existence orposition (direction) of other speakers than the user. In one example, ina case where a voice is acquired from a direction other than the user,the controller 160 may determine that there is another speaker andspecify the direction. Furthermore, in a case where it is recognizedthat the voice of another speaker is acquired by voice recognition, thecontroller 160 may determine that another speaker is present.Furthermore, the controller 160 may specify the existence and theposition of another speaker based on a result of image recognition onthe captured image obtained by the image capture unit 120. Furthermore,the controller 160 may compare the information on the position of theuser acquired by the GPS module included in the sensor unit 140 with theinformation on the position of the other speaker, thereby specifying theexistence and the position of the other speaker. Furthermore, thecontroller 160 may specify the existence and the position of the otherspeaker by measuring the radio wave intensity of radio waves (e.g., theradio field strength of Wi-Fi) emitted from a device held by the otherspeaker.

In one example, the controller 160 may control the beamformingprocessing based on information indicating the state of the user. Thestate of the user may refer to a motion state, such as when the user isrunning, walking, or riding a vehicle. In one example, the controller160 can estimate the motion state of the user in accordance with thesensing result acquired by the sensor unit 140. The controller 160 mayestimate the detailed motion state by combining a plurality of sensingresults. In one example, the combination of the sensing results obtainedby the vibration sensor and the speedometer allows the controller 160 toestimate that the state is in bicycling if it is determined that thevibration level and velocity are larger than when walking. In addition,the controller 160 may estimate that the state is in riding in anautomobile if the vibration level is lower than the case of riding abicycle and the velocity is higher than the case of riding a bicycle.Then, the controller 160 may enlarge or reduce the range of directivityto be formed depending on the estimated motion state of the user. In oneexample, if the intensity of motion indicated by the motion state (e.g.,numerical values outputted from each sensor) is relatively large, thecontroller 160 may increase the range of directivity, as compared withthe case where the motion is small. Moreover, the enlargement orreduction of the range of directivity may be regarded as enlarging orreducing the range of an area indicating the sensitivity equal to orhigher than a predetermined value with respect to the incoming sound. Inaddition, the state of the user may indicate the user's body posturesuch as the orientation and posture of the face of the user. In oneexample, the controller 160 may estimate the orientation of the user'sface based on a result of image recognition on the captured imageobtained by the image capture unit 120, and may control the orientationof directivity depending on the orientation. In this case, even when theorientation of the face changes and the positional relationship betweenthe user's mouth and the voice acquisition unit 110 changes, thecontroller 160 can control the directivity to acquire clearly a voiceuttered from the mouth.

Furthermore, the controller 160 may perform processing in accordancewith the result of voice recognition executed based on the voice dataobtained by performing the beamforming processing. The voice recognitionprocessing may be executed by the controller 160 or may be executed byanother device such as a server on the cloud. In one example, thecontroller 160 may control the operation of the voice processing system1 based on a result of voice recognition. Specifically, the controller160 may control the directivity associated with the beamformingprocessing based on the result of voice recognition. This makes itpossible for the user to instruct by voice, in one example, to directthe directivity in the direction of the voice to be recorded. Inaddition, the controller 160 may start or stop the image capturing withthe camera, or record a specific sensing result, based on the result ofvoice recognition. This makes it possible for the user to instruct byvoice, in one example, the landscape or motion state to be recorded.

Moreover, the controller 160 can be implemented as, in one example, amobile processor. As described above, the controller 160 may be includedin the mounting unit, or may be included in any other device such as asmartphone or a server on the cloud.

(7) Others

In addition, the voice processing system I can have various components.In one example, the voice processing system 1 may have a battery. Asillustrated in FIGS. 1 to 3, the mounting unit can have a curved shape,and thus it is desirable that the battery may be a curved battery havinga curved surface. Furthermore, the voice processing system 1 may have aconnector for charging to which a cable for charging the battery can beconnected. The connector for charging may be a connector for bothcharging and communication, which has a function as a connector forcommunication capable of connecting a cable for communication.Furthermore, the voice processing system 1 may have a vibrator thatfunctions as an output device for the user. Furthermore, the voiceprocessing system 1 may have a loudspeaker that functions as an outputdevice to the user. Furthermore, the voice processing system 1 may havean earphone connector capable of connecting an earphone that functionsas an output device to the user. The earphone connector may have amagnetic force, and the earphone connector and the earphone may bedetachable by a magnetic force. Furthermore, the voice processing system1 may have a storage unit for storing the voice data after thebeamforming processing by the controller 160.

The internal configuration of the voice processing system 1 according tothe present embodiment has been described above. Next, an operationprocess of the voice processing system 1 according to the presentembodiment will be described with reference to FIG. 12.

<4. Operation Processing>

FIG. 12 is a flowchart illustrating an example of a voice signalprocessing procedure executed in the voice processing system 1 accordingto the present embodiment.

As illustrated in FIG. 12, in step S102, the voice processing system 1acquires voice data. In one example, the voice acquisition units 110A,110B, 110C, and 110D acquire voice data and output it to the controller160.

Next, in step S104, the voice processing system 1 acquires informationindicating the positional relationship between a sound source and thevoice acquisition unit 110. The sound source may be a noise source, auser's mouth that is a source of user's voice, or a speaker other thanthe user. The controller 160 acquires information indicating thepositional relationship between the sound source and the voiceacquisition unit 110, specifically, information indicating the directionviewed from the voice acquisition unit 110. Examples of such informationinclude a result of voice recognition on a voice acquired by the speechacquisition unit 110, a result of image recognition on a captured imageobtained by the image capture unit 120, information indicating a userinput acquired by the operation unit 130, a sensing result by the sensorunit 140, and information acquired from another device through thecommunication unit 150.

Next, in step S106, the voice processing system 1 acquires informationindicating the state of the user. In one example, the controller 160acquires information indicating the user's motion state or the user'sbody posture. Examples of such information include a result of voicerecognition on a voice acquired by the speech acquisition unit 110, aresult of image recognition on a captured image obtained by the imagecapture unit 120, information indicating a user input acquired by theoperation unit 130, a sensing result by the sensor unit 140, andinformation acquired from another device through the communication unit150.

Then, in step S108, the voice processing system 1 performs beamformingprocessing. In one example, the controller 160 performs the beamformingprocessing of forming directivity for acquiring a voice coming from thedirection of the user's mouth, using the plurality of voice data itemsacquired in step S102. In this case, the controller 160 may control thebeamforming processing to reduce the noise based on the positionalrelationship between the noise source and the voice acquisition unit110. Furthermore, the controller 160 may perform beamforming processingfor enhancing or reducing a voice coming from a speaker other than theuser based on the position of a speaker other than the user.Furthermore, the controller 160 may control the direction and/or rangeof forming the directivity depending on the state of the user.

Then, in step S110, the voice processing system 1 performs voicerecognition processing. In one example, the controller 160 executes thevoice recognition processing based on the voice data obtained byperforming the beamforming processing. Then, the controller 160 maycontrol the operation of the voice processing system 1 depending on aresult obtained by performing the voice recognition.

An example of the voice signal processing procedure executed in thevoice processing system 1 has been described above.

<5. Brief Summary>

The embodiments of the present disclosure have been described in detailabove with reference to FIGS. 1 to 12. As described above, the voiceprocessing system 1 according to the present embodiment has at leastthree voice acquisition units in the mounting unit. This makes itpossible for the voice processing system 1 to acquire voice datasuitable for performing beamforming processing for making the user'svoice more clear.

Although the preferred embodiment(s) of the present disclosure has/havebeen described in detail above with reference to the accompanyingdrawings, the technical scope of the present disclosure is not limitedto the above examples. A person skilled in the art may find variousalterations and modifications within the scope of the technical ideadescribed in the claims, and it should be understood that they willnaturally come wider the technical scope of the present disclosure.

The series of processes carried out by each device described in thepresent specification may be implemented by using software, hardware, ora combination of software and hardware. Programs that constitute thesoftware may be stored previously, in one example, on storage medium(non-transitory media) provided inside or outside each device. In oneexample, such program is loaded onto random access memory (RAM) inexecuting it by a computer and executed by a processor such as CPU.

Furthermore, the processes described with reference to the flowchartsand sequence diagrams herein are not necessarily executed in the orderillustrated. Some processing steps may be executed in parallel.Furthermore, some of additional steps can be employed, or some otherscan be omitted.

Furthermore, the effects described in this specification are merelyillustrative or exemplary, and are not restrictive. That is, thetechnology according to the present disclosure may achieve other effectsthat are obvious to those skilled in the art from the description ofthis specification in conjunction with or in place of the above effects.

Additionally, the present technology may also be configured as below.

(1) A voice processing system including: a mounting unit configured tobe attached to a user, wherein the mounting unit includes at least threevoice acquisition units configured to acquire voice data forbeamforming.

(2) The voice processing system according to (1), wherein the mountingunit includes at least four voice acquisition units, and the four voiceacquisition units form a three-dimensional shape by interconnectingpositions at which the four voice acquisition units are provided.

(3) The voice processing system according to (1) or (2), wherein, in astate in which the mounting unit is attached to the user, the four voiceacquisition units are provided so that a distance between a first voiceacquisition unit included in the four voice acquisition units and amouth of the user is different from a distance between a second voiceacquisition unit included in the four voice acquisition units and themouth of the user.

(4) The voice processing system according to (3), wherein, in a state inwhich the mounting unit is attached to the user, the first voiceacquisition unit is provided at a position closest to the mouth of theuser as compared with the other voice acquisition units, and the secondvoice acquisition unit is provided closer to a feet side of the userthan the first voice acquisition unit in an upright posture of the user.

(5) The voice processing system according to (3) or (4), wherein thefirst voice acquisition unit and the second voice acquisition unit areprovided closer to a feet side of the user than the mouth of the user inan upright posture of the user.

(6) The voice processing system according to any one of (2) to (5),wherein the voice acquisition unit is a microphone havingomnidirectional sensitivity.

(7) The voice processing system according to (6), wherein the voiceacquisition unit is a microphone whose sensitivity is uniform orsubstantially uniform in all directions.

(8) The voice processing system according to any one of (2) to (7),further including:

a controller configured to perform beamforming processing of formingdirectivity for acquiring a voice coming from a direction of the mouthof the user using a plurality of voice data items acquired by the voiceacquisition unit.

(9) The voice processing system according to (8), wherein thebeamforming processing is a process of changing a degree of enhancementfor each area where sound arrives.

(10) The voice processing system according to (9), wherein thebeamforming processing includes a process of reducing sound coming froma specific area.

(11) The voice processing system according to any one of (8) to (10),wherein the controller controls the beamforming processing based onpositional relationship between a noise source and the voice acquisitionunit.

(12) The voice processing system according to any one of (8) to (11),wherein the controller controls the beamforming processing based on aposition of a speaker other than the user.

(13) The voice processing system according to any one of (8) to (12),wherein the controller controls the beamforming processing based oninformation indicating a state of the user.

(14) The voice processing system according to any one of (8) to (13),wherein the controller performs processing in accordance with a resultof voice recognition executed based on voice data subjected to thebeamforming processing.

(15) The voice processing system according to (14), wherein thecontroller controls an operation of the voice processing system based onthe result of the voice recognition.

(16) The voice processing system according to (15), wherein thecontroller controls the directivity based on the result of the voicerecognition.

(17) The voice processing system according to any one of (8) to (16),wherein the mounting unit includes the controller.

(18) The voice processing system according to any one of (2) to (17),wherein the mounting unit is worn around a neck of the user.

Reference Signs List

1 voice processing system

110 voice acquisition unit

120 image capture unit

130 operation unit

140 sensor unit

150 communication unit

160 controller

1. A voice processing system comprising: a neckband type mounting unitconfigured to be worn on a neck of a user and shaped to make a turnaround the neck of the user from a right side and a left side of theneck to a back side of the neck; a first voice acquisition unitconfigured to be provided on the mounting unit; and a second voiceacquisition unit configured to be different from the first voiceacquisition unit on the mounting unit, wherein a position of the firstvoice acquisition unit is closer to the user's mouth than a position ofthe second voice acquisition unit, wherein the position of the secondvoice acquisition unit is provided on a lower side or a fore side in anupright posture of the user with respect to the position of the firstvoice acquisition unit, and wherein a direction of the second voiceacquisition unit is different from a direction of the first voiceacquisition unit.
 2. The voice processing system according to claim 1,further comprising: a controller configured to acquire a voice comingfrom the user using voice data acquired by the first voice acquisitionunit and the second voice acquisition unit.
 3. The voice processingsystem according to claim 2, further comprising: a communication unitconfigured to communicate with another device by a wireless connectionand transmit the acquired voice to the other device.
 4. The voiceprocessing system according to claim 3, wherein the communication unitcommunicates with the other device by using Bluetooth.
 5. The voiceprocessing system according to claim I., further comprising: anoutputting unit configure to output an output voice to an earphone.